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(54) Virtual vehicle sensors based on neural networks trained using data generated by simulation 
models 



(57) A virtual vehicle sensor includes a neural net- 
work which produces a sensor output based on a linear 
combination of non-linear physical signals generated by 
conventional physical sensors. Instead of determining 
an output directly, the neural network determines the 
polynomial coefficients as functions of the physical sig- 
nals indicative of other engine operating parameters. 
The sensor is manufactured using relatively limited data 
collection to calibrate a simulation model. The output of 
the simulation model is used for model-based nnapping 
to generate more comprehensive maps used tor training 
the neural network. The trained neural network is em- 
bedded in a controller and acts as the virtual sensor to 
monitor engine parameters which are difficult to meas- 
ure or for which conventional physical sensors do not 
currently exist. The virtual sensor may be used to sense 
parameters such as in-cylinder residual mass fraction, 
emission levels, in-cylinder pressure rise during com- 
bustion, and exhaust gas temperature. 
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Description 

The present invention relates to virtual vehicle sen- 
sors which use neural networks trained using a simula- 
tion model to monitor a vehicle parameter. s 

Modem engines utilise an electronic engine control 
module (ECM) to continuously monitor and control en- 
gine operation to optimize fuel economy, emissions con- 
trol, and performance. The ECM uses various physical 
sensors to collect information reflecting current operat- io 
ing conditions. The information is used to generate out- 
put signals for various actuators which control operation 
of the engine. Using the actuators, the ECM controls the 
air-fuel ratio, fuel injection, ignition timing, and various 
other functions to control operation of the engine. Opti- is 
mal control of the engine over a wide range of engine 
operating conditions (and ambient conditions) depends 
on the availability accuracy, and reliability of data gath- 
ered by the engine sensors. 

An ideal engine control system would be capable of 20 
directly measuring each engine operating parameter 
which affects any control variable. However, any realiz- 
able design is subject to considerations such as the 
cost, durability, repairability, and/or technological feasi- 
bility (including packaging considerations) of appropri- 2s 
ate sensors. The deployment of more and more physical 
sensors results in per-unit cost penalties in development 
and manufacturing. Replacement and repair costs also 
rise due to the increased number of sensors and diffi- 
culty in diagnosing sensor malfunctions. As such, actual 30 
systems typically involve design compromises to ac- 
commodate technological difficulties and reduce the 
cost and complexity of the physical system employed to 
monitor and control the engine. It is therefore desirable 
to improve the availability, accuracy, and reliability of da- 3S 
ta used to effect engine control without significantly im- 
pacting the cost, complexity, or repairability of the vehi- 
cle. 

The present invention uses one or more neural net- 
works within the ECM which act as virtual sensing de- 40 
vices to replace or enhance traditional physical engine 
sensors. The neural networks are trained using data 
produced by a simulation model calibrated with actual 
engine test data. Use of the simulation model reduces 
the development time required while providing insight 46 
into the effect of various design parameters on engine 
operation. 

The present invention provides a method for con- 
trolling a vehicle component using a plurality of physical 
sensors for sensing first operating parameters and a so 
controller in communication with the plurality of physical 
sensors. The method includes monitoring signals gen- 
erated by the plurality of physical sensors to determine 
values for the first ope rat ing parameters and processing 
the values for the first operating parameters using a neu- ss 
ral network embedded in the controller to determine a 
value for a second operating parameter. The value for 
the second operating parameter is based on a linear 



combination of the plurality of values for the first oper- 
ating parameters such that tne neural networi< functions 
as a sensor for the second operating parameter. The 
method also includes controlling the vehicle component 
based on the value of the second operating parameter. 

The neural network is trained using data generated 
by a simulation model. The simulatbn model is calibrat- 
ed using test data gathered during operation of the ve- 
hicle component. The trained neural network is embed- 
ded in the controller to function as a virtual sensor to 
sense the second operating parameter to provide im- 
proved control of the vehicle component. 

Numerous advantages are associated with the 
present invention. For example, the present invention 
allows sensing of operating parameters which are cur- 
rently difficult or cost -prohibitive to measure directly 
The present invention utilizes simulation models to gen- 
erate more comprehensive data representing more op- 
erating conditions than would be economically feasible 
using traditional testing and mapping. The comprehen- 
sive data results in more accurate training of the neural 
networks thereby leading to a more accurate sensor 
The sensor may be used to provide monitoring of fun- 
damental physical quantities characterizing operation of 
the vehicle components which are othenA/ise unavaila- 
ble using physical sensors. The present invention is ap- 
plicable to a wide variety of control systems although 
particularly suited for control of vehicle engines. 

The invention will now be described, by way of ex- 
ample, with reference to the accompanying drawings, 
in which: 

Figure 1 is a block diagram illustrating an engine 
control application utilizing one embodiment of the 
present invention; 

Figure 2 is a block diagram Illustrating a virtual sen- 
sor based on a neural network structure according 
to the present invention; and 
Figure 3 is a flowchart illustrating a method for de- 
veloping and manufacturing a virtual sensor ac- 
cording to the present invention. 

Referring now to Figure 1 , a block diagram is shown 
Illustrating one potential application for a virtual sensor 
according to the present invention. A control system 10 
includes a vehicle component such as engine 1 2 in com- 
munication with a controller 14. System 10 includes a 
plurality of physical sensors, indicated generally by ref- 
erence numeral 16. Any number of physical sensors 16 
may be used depending upon the particular application 
and the particular vehicle component being controlled. 
Physical sensors 1 6 may include a mass air flow (MAF) 
sensor 1 8, a throttle position sensor (TPS) 20, an engine 
speed sensor (RPM) 22, and/or a coolant temperature 
(TMP) sensor 24. 

In many gasoline-powered automotive applica- 
tions, engine 12 is coupled to a catalytic converter 26 
via an exhaust pipe 28. Catalytic converter 26 is typically 
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coupled to a muffler (not specifically illustrated) via ex- 
haust pipe 30. In these applications, additional physical 
sensors 1 6 may include an upstream exhaust gas oxy- 
gen (EGO) sensor 32. a downstream EGO sensor 34, 
and a catalytic converter temperature sensor 36. Vari- 
ous other vehicle sensors may also be included, such 
as vehicle speed sensor (VSS) 38 and manifold abso- 
lute pressure (MAP) sensor 39. 

In operation, controller 14 monitors signals gener- 
ated by physical sensors 16 to determine values for the 
corresponding operating parameters of engine 12. Sig- 
nals generated by physical sensors 1 6 are communicat- 
ed to one or more input ports 40. Appropriate signal con- 
ditioning, buffering, circuit protection, and signal conver- 
sion is typically provided by circuitry within controller 1 4. 
For example, a temperature signal generated by coolant 
temperature sensor 24 may be filtered, buffered, and 
converted to a digital signal by the circuitry within con- 
troller 14 prior to passing through input ports 40. 

Controller 14 of Figure 1 preferably includes a mi- 
croprocessor unit (MPU) 42 in communication with var- 
ious computer-readable storage media, indicated gen- 
erally by reference numeral 44. Computer-readable 
storage media 44 may include various types of volatile 
and non-volatile memory such as keep-alive memory 
(KAM) 46, read only memory (ROM) 48, and random 
access memory (RAM) 50. Computer-readable storage 
media 44 communicate with microprocessor 42 via ad- 
dress and data bus 52. Microprocessor 42 processes 
values corresponding to various operating parameters 
as indicated by the signals received through input ports 
40 in accordance with data and instructions stored in 
computer-readable media 44. 

Microprocessor 42 generates control and command 
signals which are communicated via output ports 54 to 
various actuators, indicated generally by reference nu- 
meral 55. Actuators may include a fuel controller 58 
which provides appropriate signals for one or more fuel 
injectors (not specifically illustrated). Other actuators 
may include a spark controller 60 and an exhaust gas 
recirculation (EGR) valve 62. EGR valve 62 is used to 
control the amount of exhaust gases routed from ex- 
haust 28 to intake 64 via plumbing 66. 

As also illustrated in Figure 1, controller 14 includes 
a neural network-based virtual sensor 68 according to 
the present invention. The virtual sensor is preferably 
embedded within controller 1 4 and may exist across or 
within one or more computer-readable storage media 
44. For example, various instructions may be stored in 
one type or one physical storage media while working 
data is stored in another physical device which may or 
may not be of the same type of storage media. 

Virtual sensor 68 may be used to determine a value 
for an ngine operating param ter which is difficult or 
costly to measure directly. Values for various physical- 
based parameters are input to virtual sensor 68, such 
as those values which represent the physical signals 
generated by physical sensors 1 6. Various other signals 
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may provide input to virtual sensor 68 to dynamically de- 
termine values for various engine operating parameters. 
Such signals may be indicative of air/fuel ratio, cam tim- 
ing, air charge temperature, oil temperature, and the 
s like. Virtual sensor 68 forms a linear combination of non- 
linear functions of physically-based parameters. Virtual 
sensor 68 then determines values for various other en- 
gine operating parameters which are difficult to meas- 
ure. Such parameters may include residual mass frac- 
10 tion. emissions, knock index, peak pressure rise rate, 
exhaust gas temperature, and exhaust gas oxygen con- 
tent. The output from one or more virtual sensors ena- 
bles controller 1 4 to better account for the internal proc- 
esses of engine 1 2. This information may be used to 
IS improve control of engine 1 2 by adjusting various func- 
tions such as spark timing, EGR level, fuel injection tim- 
ing, cam timing, or fuel pulsewidth to minimize fuel con- 
sumption, emissions, knock tendency, engine Instability, 
and noise, vibration, and harshness (NVH) effects. As 
20 such, the present invention improves engine control by 
providing information representing dynamic engine 
state conditions based on various non-linear relation- 
ships among physical -based signals. The non-linear re- 
lationships are captured automatically by the neural net- 
25 work during training, as described in greater detail here- 
in. 

Referring now to Figure 2, a block diagram illustrat- 
ing a neural network structure for a virtual sensor ac- 
cording to the present invention is shown Virtual sensor 
30 68 includes varbus inputs 80 generated by physical 
sensors and/or other virtual sensors. An input layer 82 
includes nodes 84 associated with each of the inputs 
80. The neural network-based sensor 68 also includes 
one or more hidden layers 86 and an output layer 88. 
35 Nodes 84 of input layer 82 communicate with one or 
more nodes 90 of hidden layers 86 via connections 92. 
During training of the network, the various connections 
along with associated weights are determined. Block 94 
represents a polynomial function of its inputs to gener- 
ic ate a sensor output 96. The degree of the polynomial 
employed in block 94 is constrained to be one less than 
the number of nodes in output layer 88. For most virtual 
sensors, a feed-forward neural network will provide sat- 
isfactory performance. It should be recognized, howev- 
45 er, that the number and structure of nodes for each layer 
will vary depending upon the particular parameter being 
determined. 

The particular structure illustrated in Figure 2 de- 
picts a neural network for a set of engine performance 

so variables using knowledge that most of the variables are 
low-order polynomial functions of the spark input when 
all the other parameters are fixed. Instead of predicting 
the output directly, the neural network of Figure 2 pre- 
dicts the polynomial coefficients represented by block 

55 g4 as functions of the other engine operating parame- 
ters. It should be noted that this type of neural-regres- 
sion model is not restricted to the use of polynomials as 
any functional module may be employed which allows 
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determinatbn of the partial derivatives of the module's 
output with respect to the neural network's weights to 
be computed. 

Indeed, the choice of non-polynomial functions is 
often preferred because of the tendency of interpolating s 
polynomials to exhibit large errors when used to extrap- 
olate outside the bounds of the underlying data. 

Once a particular network structure or model is de- 
termined, the training of the network or the adjustment 
of the weights associated with each of the connections io 
92 between nodes or neurons can be carried out using 
established algorithms, such as the Levenburg-Mar- 
quardl algorithm or the Node Decoupled Extended Ka- 
Iman filler algorithm developed by Puskorlus and Feld- 
kamp For some engine control applications, the latter is 
algorithm exhibits superior convergeiic-. properties re- 
sulting in IrtSier training of the network while also yield- 
ing networks possessing better generalization capabili- 
ties compared lo simple back propagation algorithms. It 
is dcsiri^blc lo utilise an architecture which is capable of 20 
fepicbenliny d paiticulai parameter map to a desired 
degree of accuracy while lending itself to automatic 
training procedures as explained and illustrated with ref- 
erence lo Figure 3. 

Referring now to Figure 3. a flowchart illustrating a 25 
method for manufacturing or developing neural net- 
work-based virtual sensors is shown. Block 100 repre- 
sents the generation of test data during operation of a 
vehicle component, such as an engine. The test data 
provides representative values for a plurality of operat- 30 
ing parameters for a particular set of operating condi- 
tions To capture the relationship among the various in- 
puts over all the operating conditions, It is desirable to 
generate a large set of data which reflects the typically 
non-linear relationship among basic engine operating 35 
parameters and the desired sensor output. Typically, 
this objective cannot be accomplished using conven- 
tional dynamometer testing alone because some engine 
parameters are not easily measured, and such a com- 
prehensive map would be cost prohibitive. As such, the 40 
present invention requires only enough test data to cal- 
ibrate a physically-based simulation model as repre- 
sented by block 102. 

Preferably, test data generated in block 100 is used 
to calibrate the simulation model represented by block 45 
102 at one or several representative "anchor" points. 
The simulation program can then be used to interpolate 
or extrapolate a more complete set of data as represent- 
ed by block 104. This comprehensive map characteriz- 
es performance of the vehicle component as a function so 
of predetermined design and control parameters. This 
infomnation is then used to program or train the neural 
network-based virtual sensor as represented by block 
106. The sensor is then embedded In the controller In 
the form of data and instructions as represented by ss 
block 108. 

The model-based mapping using established first 
principle parametric simulation models requires only 



about 1% of the experimental test data compared to the 
data required for a full empirical map. As such, the 
present Invention has the potential for a two-thirds sav- 
ings in cost while reducing the time required to generate 
a complete map from about a month to the order of a 
week. 

As described above, the present invention may be 
utilized to provide a virtual sensor for any of a number 
of operating parameters for various vehicle components 
to realize a "virtual" closed-loop control system. As an 
example, the present inventbn may be utilized to pro- 
vide a virtual sensor for engine control systems which 
dynamically determine the residual mass fraction using 
various physically-based sensor inputs. 

The residual mass fraction (RMF), as used herein, 
refers to that fraction of the cylinder contents trapped in 
the current cycle which has been burned in some pre- 
vious cycle. This may also be referred to as the burned 
gas fraction. RMF has both external and internal sourc- 
es in conventional intemal combustion engine opera- 
tion. Exhaust gas recycling or recirculation (EGR) is the 
primary external source. EGR is introduced by routing 
some of the exhaust gases from the exhaust manifold 
back to the intake manifold via external plumbing. The 
amount of EGR introduced into the intake is regulated 
by an EGR valve at the point where the exhaust gases 
enter the intake manifold. The intemal source (some- 
times referred to as internal EGR) arises due to the in- 
ability of the gas exchange process in conventional en- 
gine designs to completely replace the burned gases 
with fresh air/fuel mixture. The amount of residual is in- 
fluenced by the setting of the EGR valve, the throttle 
position, and the valve overlap, i.e. the period of time 
where both the intake and exhaust valves are open. Ex- 
cessive dilution by residual from any source can de- 
grade combustion quality. However, limited levels of re- 
sidual under throttled operation have beneficial effects 
on emissions and fuel economy. 

As RMF increases, it displaces fresh charge. In or- 
der to trap the fuel and air required to maintain the re- 
quired level of engine torque output, the throttle must be 
opened up so that more total gases become trapped in 
the combustion chamber. The heat liberated by the com- 
bustion is distributed over a larger mass, thus lowering 
peak temperatures during combustion. Production of 
oxides of nitrogen (NOx). being very sensitive to com- 
bustion temperature, is thereby reduced significantly. 
Opening up the throttle valve also increases the intake 
pressure which reduces throttling losses and improves 
fuel economy 

It is common practice to use EGR to control the level 
of RMF to maximize fuel economy and minimize NO^ 
emissions at each speed and torque throughout the op- 
erating range of the engine. The appropriate amount of 
EGR is generally determined experimentally by testing 
the engine at each condition on a dynamometer prior to 
installation in the vehicle. The engine controller is then 
programmed to supply the correct level of EGR as a 
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function of engine speed and torque. 

With the advent of variable valve tinning mecha- 
nisms as practical in-vehicle devices, the level of inter- 
nal EGR can be controlled by changing the opening and 
closing times of the intake and exhaust valves. This 
method of controlling RMF can either supplant or com- 
plement the external EGR system. A control strategy 
analogous to the EGR methodology could be devised 
for variable valve timing. One could find an optimal valve 
timing at each operating condition and program the re- 
sulting set into the engine controller. 

In either case, RMF is the fundamental engine pa- 
rameter which is being controlled. The present invention 
may be utilized to develop a more robust control strategy 
since RMF may be dynamically determined and there- 
lore controlled. Once the value for a particular parame- 
ter (RMF in this case) can be directly determined, tradi- 
tional control techniques may be applied, i.e. comparing 
the measured value to the optimal, and adjusting either 
EGR or valve liming to correct any deviation. 

The cycle simulation program used according to the 
present invention calculates the thermodynamic state of 
the engine as a function of time, or crank angle, during 
the combustion cycle. The simulation tracks pressures, 
temperatures, and composition of the gases in the cyl- 
inder intake system, and exhaust system by solving a 
set of differentia! equations. The composition of the cyl- 
inder is governed by the conservation equations for total 
mass and fresh charge fraction: 

mc = - ni^-Cy - ■ ■ 

m — fHj - 



r= /-c 

where: 



(c if rhg > 0, Ce if rTi^ < 0. 

Cj represents charge fraction of gas residing in the in- 
take port, and 

5 

c^ represents charge fraction of gas residing in the ex- 
haust port. 

The engine can then be tested at all the relevant 
10 speed/torque combinations representative of its operat- 
ing range. At each point, dilution RMF can be varied by 
changing EGR and/or valve timing as previously de- 
scribed. The cycle simulation program can be used to 
calculate the value of RMF as these parameters are var- 
is ied to generate a comprehensive map. When the opti- 
mal level of dilutbn is ascertained, the associated RMF 
is established as the target value for that speed and 
torque. 

Meanwhile, the cycle simulation program can be 

20 used to calculate RMF as a function of all engine oper- 
ating parameters (speed, torque, EGR, valve timing, 
spark advance, inlet temperature, etc.) These results 
can then be used to construct the virtual RMF sensor. If 
the virtual sensor is implemented through a neural net, 

25 these data comprise the training set by which the net 
learns the functional dependence of RMF on various 
other physical-based operating parameters. Of course, 
a virtual sensor according to the present invention may 
also use the outputs from various other virtual sensors 

30 as inputs. 

During operation in the vehicle, the controller inter- 
rogates the virtual sensor to determine the RMF asso- 
ciated with the current values for the operating param- 
eters. This RMF value is compared to the previously de- 

35 termined optimal value for the current operating condi- 
tions as described above. If necessary, the controller 
carl signal the actuator(s) controlling the appropriate pa- 
rameter(s) e.g. valve timing to move RMF toward the 
optimal value. 

40 



m represents the total mass in the cylinder, 

c represents the mass fraction of fresh charge in the 
cylinder, 

r represents the RMF in the cylinder, 

rhj represents the mass flow rate into the cylinder 

through the intake valve(s), ^o 

rhg represents the mass flow rate out of the cylinder 
through the exhaust valve(s), 

Cj represents the charge fraction associated with rrij 55 
(c if rhj < 0, Cj if ririj > 0), 

c^ represents the charge fraction associated with rh^ 



Claims 

1 . A method of manufacturing a sensor for use with 
a vehicle component having a controller in commu- 
nication with a plurality of physical sensors each 
generating a signal indicative of first operating pa- 
rameters, the sensor determining values for a sec- 
ond operating parameter based on values for the 
plurality of first operating parameters, the method 
comprising: 

generating test data during operation of the ve- 
hicle component repres ntative of values for 
the plurality of first operating parameters for a 
first set of operating conditions; 
calibrating a simulator for simulating operation 
of the vehicle compon nt using the test data; 
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generating at least one map which characteriz- 
es performance of the vehicle component as a 
function of predetermined parameters, the map 
being based on output of the simulator for a 
second set of operating conditions; 5 
adjusting weights corresponding to nodes of a 
neural network based on the at least one map 
so as to develop a trained neural network; and 
embedding the trained neural network into the 
controller such that the trained neural network io 
determines values for the second operating pa- 
rameter based on values for the plurality of first 
operating parameters. 

2. A method as claimed in claim 1 , wherein the ve- is 
hide component comprises an engine and wherein 

the step of generating test data comprises operat- 
ing the engine on a dynamometer. 

3. A method as claimed in claim 1 , wherein the step 20 
of embedding comprises storing a representation of 

the trained neural network in computer readable 
media, the representation including a plurality of in- 
structions executable by a mk)roprocessor and data 
representing the weights corresponding to the 2S 
nodes of the neural network. 

4. A method as claimed in claim 1 , wherein the step 
of adjusting weights comprises adjusting weights 
corresponding to monotonically increasing piece- 30 
wise differentiable function nodes of the neural net- 
work. 

5. A method for controlling a vehicle component us- 
ing a plurality of physical sensors for sensing first 35 
operating parameters and a controller in communi- 
cation with the plurality of physical sensors, the 
method comprising: 

monitoring signals generated by the plurality of 40 
physical sensors to determine values for the 
first operating parameters; 
processing the values for the first operating pa- 
rameters using a neural network embedded in 
the controller to determine a value for a second 
operating parameter, the value for the second 
operating parameter being based on a linear 
combination of the plurality of values for the first 
operating parameters such that the neural net- 
work functions as a sensor for the second op- so 
e rating parameter; and 

controlling the vehicle component based on the 
value of the second operating parameter. 

6. A method as claimed in claim 5. wherein the step ss 
of processing comprises processing the values for 

the first operating parameters to determine the val- 
ue for the second operating parameter, the second 



operating parameter lacking a conventional physi- 
cal sensor for directly providing values indicative of 
current operating conditions. 

7. A method as claimed in claim 6, wherein the ve- 
hicle component comprises an engine and wherein 
the step of processing comprises processing the 
values for the first operating parameters to deter- 
mine a value for residual mass fraction. 

8. A method as claimed in claim 5, wherein the step 
of processing comprises determining polynomial 
coefficients for the second operating parameter, the 
coefficients being functions of the first plurality of 
operating parameters. 

9. A computer readable storage medium having 
stored therein instructions executable by a micro- 
processor to control a vehicle component using a 
plurality of physical sensors in communication with 
the microprocessor for sensing first operating pa- 
rameters, the storage medium comprising: 

instructions for monitoring signals generated by 
the plurality of physical sensors to determine 
values for the first operating parameters; 
instructions for processing the values for the 
first operating parameters using a neural net- 
work to determine a value for a second operat- 
ing parameter, the value for the second operat- 
ing parameter being based on a linear combi- 
nation of the plurality of values for the first op- 
erating parameters such that the neural net- 
work functions as a sensor for the second op- 
erating parameter; and 
instructions for controlling the vehicle compo- 
nent based on the value of the second operat- 
ing parameter. 

8. A computer storage medium as claimed in claim 

9, wherein the instructions for processing comprise 
instructions for processing the values for the first 
operating parameters to detennine the value for the 
second operating parameter, the second operating 
parameter lacking a conventional physical sensor 
for directly providing values indicative of current op- 
erating conditions. 
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GENERATE TEST DATA 
DURING OPERATION OF 

COMPONENT 



CALIBRATE SIMULATION 
MODEL USING TEST 
DATA 



GENERATE 
COMPREHENSIVE MAP(S) 
USING OUTPUT OF 

SIMULATION 



TRAIN NEURAL NET(S) 
USING DATA FROM 
MAP(S) 



EMBED TRAINED NEURAL 
NET IN CONTROLLER 
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